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(54) Synchronous information reproduction apparatus 



(57) In a synchronous information reproduction ap- 
paratus, a receiving section sequentially receives a 
clock signal. A storing section stores object information 
to be sequentially reproduced from a series of reproduc- 
tion points. A reproduction point generating section gen- 
erates location information indicative of a reproduction 
point of the object information stored in the storing sec- 
tion. A reproducing section reads and reproduces the 



object information from the storing section based on the 
reproduction point generated by the reproduction point 
generating section. A synchronizing section synchroniz- 
es an incremental speed of the reproduction point gen- 
erated by the reproduction point generating section with 
a reception timing of the clock signal based on a recep- 
tion time interval of the clock signals. An outputting sec- 
tion outputs contents of the object information repro- 
duced by the reproducing section. 
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Description 

BACKGROUND OF THE INVENTION 

[0001 1 The present invention relates to a synchronous 
information reproduction apparatus : a synchronous in- 
formation reproduction method and a storage medium 
storing therein a synchronous information reproduction 
program for synchronizing and reproducing multimedia 
information such as music performance information, 
polygon CG animation data, movie data and. musical 
tone waveform sample data. 

[0002] There is known a method of synchronizing and 
reproducing multimedia information such as musical 
tones, images and voices. For example, in parallel to 
reproduction of music performance information such as 
MIDI information, various kinds of multimedia informa- 
tion such as image information like CG (computer 
graphics) images, movie images, sound, and musical 
tone waveform information are reproduced. 
[0003] However, in a conventional apparatus for re- 
producing multimedia information in association with 
music performance information, there is a problem that 
synchronism between the music performance informa- 
tion and the image information or the like is lost when a 
tempo of the music performance information is changed 
during the course of the reproduction. 
[0004] Thus, in order to eliminate such a disadvan- 
tage, there is proposed a synchronous information re- 
production method capable of synchronously reproduc- 
ing a video even if a tempo of a musical tone which is 
automatically reproduced is changed during the course 
of the reproduction (Japanese Patent Application Laid- 
open No. 333673/1998). This method prepares a syn- 
chronization information table, in which location infor- 
mation indicative of a series of song points, music tempo 
information and a time at which these sets of information 
are updated are associated with each other. This con- 
ventional method can reproduce a video synchronized 
with a change in tempo of a song by making a reference 
to the table. As a result, even if a tempo of the song is 
changed along the way, the video can be reproduced 
without losing the synchronization. However, the syn- 
chronization information table must be prepared and 
this table needs to be sequentially restructured in this 
method. Thus, the synchronization processing and cre- 
ation of the reproduction content are troublesome. 
[0005] Further, another conventional apparatus which 
associates musical information with image information 
and the like for reproduction reproduces the musical in- 
formation and the image information by a single player 
device, but does not reproduce the musical information 
and the associated image information by using a multi- 
ple of player devices connected through a network and 
the like. 

[0006] Furthermore, in order to reproduce the musical 
information and the image information, a time difference 
after starting reproduction process or commanding 



reading of each information till an actual output is not 
taken into consideration, and hence there is no guaran- 
tee that each information is reproduced with desired tim- 
ing. 

5 [0007] Moreover, there is a demand for reproducing 
not only the image information but also other multimedia 
information such as musical tone, e.g., WAVE data or 
sound waveform sample data in association with the 
MIDI performance information. 

10 

SUMMARY OF THE INVENTION 

[0008] Therefore, it is an object of the present inven- 
tion to provide a synchronous information reproduction 
15 apparatus, a synchronous information reproduction 
method and a storage medium storing therein a syn- 
chronous information reproduction program capable of 
synchronously reproducing multimedia information with 
reduced processing burdens. 

20 [0009] Further, it is another object of the present in- 
vention to provide a synchronous information reproduc- 
tion apparatus, asynchronous information reproduction 
method and a storage medium storing therein a syn- 
chronous information reproduction program, capable of 

25 absorbing differences in the processing delay time of re- 
spective multimedia information, capable of completely 
synchronously reproducing the multimedia information. 
[0010] Furthermore, it is still another object of the 
present invention to provide a synchronous information 

30 reproduction apparatus, a synchronous information re- 
production method and a storage medium storing there- 
in a synchronous information reproduction program, by 
which the processing cannot be interrupted when out of 
synchronism occurs. 

35 [0011] To achieve this aim, according to one aspect 
of the present invention, there is provided a synchro- 
nous information reproduction apparatus comprising: a 
receiving means for receiving a clock signal; a storing 
means for storing object information; reproduction point 

40 generating means for generating information indicative 
of a reproduction point of the object information stored 
in the storing means; a reproducing means for reading 
and reproducing the object information from the storing 
means based on the reproduction point generated by 

45 the reproduction point generating means; a synchroniz- 
ing means for synchronizing an incremental speed of 
the reproduction point generated by the reproduction 
point generating means with a reception timing of the 
clock signal based on a reception time interval of the 

50 clock signal; and an outputtirig means for outputting a 
content of the object information reproduced by the re- 
producing means. 

[0012] Further, according to another aspect of the 
present invention, there is provided a synchronous in- 
55 formation reproduction apparatus comprising: a receiv- 
ing means for receiving a clock signal; a storing means 
for storing object information; a reproduction point gen- 
erating means for generating information indicative of a 
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reproduction point of the object information stored in the 
storing means; a reproducing means for reading and re- 
producing the object information from the storing means 
based on the reproduction point generated by the repro- 
duction point generating means; a synchronizing means 5 
for synchronizing an incremental speed of the reproduc- 
tion point generated by the reproduction point generat- 
ing means with a reception timing of the clock signal 
based on a reception time interval of the clock signal; 
an outputting means for outputting a content of the ob- w 
ject information reproduced by the reproducing means; 
and a reproduction point correcting means for measur- 
ing a time duration from start of reproduction process of 
the object information by the reproducing means till ac- 
tual output of the object information from the outputting *5 
means and correcting the reproduction point in accord- 
ance with the measured time duration. 
[0013] Furthermore, when a command by a user or 
an out of synchronism between the clock signal and the 
object information is detected or when stop of supply of 20 
the clock signal is detected, the operation of the syn- 
chronizing means is stopped, and the reproduction point 
is generated at a predetermined incremental speed in 
the reproduction point generating means. 
[0014] Moreover, selection of the object information 25 
stored in the storing means and control of the reproduc- 
tion process by the reproducing means are carried out 
in accordance with an externally supplied signal. 
[0015] In addition, the object information is divided in- 
to blocks in accordance with the clock signal interval. 30 
[0016] Additionally, according to still another aspect 
of the present invention, there is provided a synchro- 
nous information reproduction apparatus comprising: a 
storing means for storing a plurality of sets of object in- 
formation; a reproduction point generating means for 35 
generating information indicative of respective repro- 
duction points of a plurality of the sets of object informa- 
tion stored in the storing means; a reproducing means 
for reading and reproducing the plurality of the sets of 
object information from the storing means based on the 40 
reproduction points generated by the reproduction point 
generating means; an outputting means for outputting 
contents of the object information reproduced by the re- 
producing means; and a reproduction point correcting 
means for measuring, for each set of object information, 45 
a time duration from start of reproduction process of the 
object information by the reproducing means till actual 
output of the object information from the outputting 
means and correcting each reproductior- point in ac- 
cordance with the measured time duration so 
[001 7] Further, according to one aspect of the present 
invention, there is provided a synchronous information 
reproduction method for reproducing one or a plurality 
of sets of object information stored in a storing means 
in synchronization with a clock signal, comprising: a re- 55 
ception step of receiving the clock signal; a generation 
step of generating location information indicative of a 
reproduction point of the object information; a reproduc- 



tion step of reading and reproducing the object informa- 
tion from the storing means based on the reproduction 
point generated by the generation step; a synchroniza- 
tion step of synchronizing an incremental speed of the 
reproduction point generated by the generation step 
with a reception timing of the clock signal based on a 
reception time interval of the clock signal; and an output 
step of outputting a content of the object information re- 
produced by the reproduction step. 
[0018] Furthermore, according to another aspect of 
the present invention, there is provided a synchronous 
information reproduction method for reproducing one or 
a plurality of sets of object information stored in a storing 
means in synchronization with a clock signal, compris- 
ing: a reception step of receiving the clock signal;, a gen- 
eration step of generating location information indicative - 
of a reproduction point of the object information; a re- 
production step of reading and reproducing the object 
information from the storing means based on the repro- 
duction point generated by the generation step; a syn- 
chronization step of synchronizing an incremental 
speed of the reproduction point generated by the gen- 
eration step with a reception timing of the clock signal 
based on a reception time interval of the clock signal; 
an output step of outputting a content of the object in- 
formation reproduced by the reproduction step; and a 
reproduction point correction step of measuring a time 
duration from start of processing in the reproduction 
step till actual output of the object information and cor- 
recting the reproduction point in accordance with the 
measured time duration. 

[0019] Moreover, when a command by a user or an 
out of synchronism between the dock signal and the ob- 
ject information is detected or when stop of supply of the 
clock signal is detected, the operation of the synchroni- 
zation step is stopped, and the reproduction point is gen- 
erated at a predetermined incremental speed in the re- 
production step. 

[0020] In addition, according to still another aspect of 
the present invention, there is provided a synchronous 
information reproduction method for reproducing a plu- 
rality of sets of object information stored in a storing 
means, comprising: a generation step of generating in- 
formation indicative of respective reproduction points of 
the plurality of the sets of object information stored in 
the storing means; a reproduction step of reading and 
reproducing the plurality of the sets of object information 
from the storing means based on the reproduction 
points generated by the generation step; an output step 
of outputting contents of trie object information repro- 
duced by the reproduction step; and a reproduction 
point correction step of measuring, for each object in- 
formation, a time duration from start of processing in the 
reproduction step till actual output of the object informa- 
tion and correcting each reproduction point in accord- 
ance with the measured time duration. 
[0021] Additionally, according to the present inven- 
tion, there is provided a storage medium for storing 
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therein a program for causing a computer to reproduce 
one or a plurality of sets of object information stored in 
a storing means in synchronization with a clock signal, 
the program comprising: a reception step of receiving 
the clock signal; a generation step of generating infor- 
mation indicative of a reproduction point of the object 
information; a reproduction step of reading and repro- 
ducing the object information from the storing means 
based on the reproduction point generated by the gen- 
eration step; a synchronization step of synchronizing an 
incremental speed of the reproduction point generated 
by the generation step with a reception timing of the 
clock signal based on a reception time interval of the 
clock signal; and an output step of outputting a content 
of the object information reproduced in the reproduction 
step. 

[0022] Further, according to another aspect of the 
present invention, there is provided a storage medium 
for storing therein a program for causing a computer lo 
reproduce one or a plurality of sets of object information 
stored in a storing means in synchronization with a clock 
signal, the program comprising: a reception step of re- 
ceiving the clock signal; a generation step of generating 
information indicative of a reproduction point of the ob- 
ject information; a reproduction step of reading and re- 
producing the object information from the storing means 
based on the reproduction point generated by the gen- 
eration step; a synchronization step of synchronizing an 
incremental speed of the reproduction point generated 
by the generation step with a reception timing of the 
clock signal based on a reception time interval of the 
clock signal; an output step of outputting a content of 
the object information reproduced in the reproduction 
step; and a reproduction point correction step of meas- 
uring a time duration from start of processing in the re- 
production step till actual output of th£ object information 
and correcting the reproduction point in accordance with 
the measured time duration. 

[0023] Furthermore, the program further comprises a 
step of stopping the operation of the synchronization 
step and generating the reproduction point at a prede- 
termined incremental speed in the reproduction step 
when a command by a user or an out of synchronism 
between the clock signal and the object information is 
detected or when stop of supply of the clock signal is 
detected. 

[0024] Moreover, according lo still another aspect of 
the present invention, there is provided a storage medi- 
um for storing therein a program for causing a computer 
to reproduce a plurality of sets of object information 
stored in a storing means in synchronization with a clock 
signal, the program comprising: a generation step of 
generating information indicative of respective repro- 
duction points of the plurality of the sets of object infor- 
mation; a reproduction step of reading and reproducing 
the plurality of the sets of object information from the 
storing means based on the reproduction points gener- 
ated by the generation step; an output step of outputting 



contents of the object information reproduced in the re- 
production step; and a reproduction point correction 
step of measuring, for each set of the object information , 
a time duration from start of processing in the reproduc- 
5 tion step till actual output of the object information and 
correcting each of the reproduction points in accordance 
with the measured time duration. 
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[0025] FIG. 1 is a functional block diagram showing a 
structure of a synchronous information reproduction ap- 
paratus to which a synchronous information reproduc- 
tion method according to the present invention is ap- 
is plied. 

[0026] FIG. 2 is a view showing the structure of one 
embodiment of the synchronous Information reproduc- 
tion apparatus to which the synchronous information re- 
production method according to the present invention is 
20 applied. 

[0027] FIG. 3 is views for explaining each song file 
stored in a main body of the apparatus and an external 
MIDI equipment, in which FIG. 3(a) is a view showing 
an example of a song file, FIG. 3(b) is a view showing 

2s an example of the data structure of reproduction data, 
and FIG. 3(c) is a view showing another example of the 
data structure of reproduction data. 
[0028] FIG. 4 is a view showing the state of synchro- 
nous reproduction when a cycle of a timing clock is ex- 

30 tended during the course of performance in the synchro- 
nous information reproduction apparatus according to 
the present invention. 

[0029] FIG. 5 is a view showing the state of synchro- 
nous reproduction when a cycle of the timing clock is 

35 shortened during the course of performance in the syn- 
chronous information reproduction apparatus. 
[0030] FIG. 6 is a flowchart for illustrating the overall 
operation of the main body of the inventive apparatus. 
[0031] FIG. 7 is a flowchart of MIDI monitoring timer 

40 interruption processing. 

[0032] FIG. 8 is a flowchart of reproduction timer in- 
terruption processing for realizing a synchronous oper- 
ation mode 1 . 

[0033] FIG. 9 is a flowchart showing a modification of 
45 the reproduction timer Interruption processing for real- 
izing the synchronous operation mode 1. 
[0034] FIG. 1 0 is a flowchart of the reproduction timer 
interruption processing for realizing a synchronous op- 
eration mode 2. 
so [0035] FIG. 11 is an operation flowchart of the external 
midi equipment. 

DETAILED DESCRIPTION OF THE INVENTION 

55 [0036] FIG. 1 is a functional block diagram showing a 
structure of a synchronous information reproduction ap- 
paratus to which a synchronous information reproduc- 
tion method according to the present invention is ap- 
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plied. In the drawing, a portion 1 surrounded by a broken 
line denotes a synchronous information reproduction 
apparatus for carrying out reproduction of object infor- 
mation, and 2 designates an external clock device for 
supplying a clock signal for synchronizing reproduction 5 
of the object information to the synchronous information 
reproduction apparatus 1 . 

[0037] In case of reproducing object information in 
synchronization with performance of a song, the object 
information including image information of, e.g., a still 10 
picture or a moving picture, CG animation image infor- 
mation indicative of the progression state of perform- 
ance of the song, musical tone waveform information 
and voice information, a clock signal whose cycle cor- 
responds to a performance tempo of the song is sup- 15 
plied from the external clock device 2, and the synchro- 
nous information reproduction apparatus 1 reproduces 
and outputs the object information in the form of the 
above-described various kinds of contents in synchro- 
nization with the clock signal. Here, even if the cycle of 20 
the clock signal supplied from the external clock device 
2 is changed during reproduction of the object informa- 
tion due to a change in the performance tempo of the 
song, it is possible to following that change in cycle of 
the clock signal in the synchronous information repro- 25 
duction apparatus 1 so that the object information can 
be reproduced and outputted without losing synchroni- 
zation. 

[0038] As a clock signal based on the music perform- 
ance information of the song supplied from the external 30 
clock device 2, a timing clock (F8) of, e.g., a MIDI mes- 
sage can be used. Further, in such a case, as the exter- 
nal clock device 2, an external MIDI equipment such as 
a sequencer or a clock master can be used, and music 
performance information (MIDI data) of that song can 35 
be supplied to the synchronous information reproduc- 
tion apparatus 1 together with the clock signal. Further- 
more, both of the music performance information of that 
song and the object information can be reproduced and 
outputted in the synchronous information reproduction 40 
apparatus 1 . Moreover, a plurality of the synchronous 
information reproduction apparatuses 1 can be connect- 
ed to a single external clock device 2 in parallel, and a 
plurality of the synchronous information reproduction 
apparatuses 1 can be used to reproduce the object in- 
formation on a plurality of mediums such as image, text, 
voice, sound and so on. In addition, reproduction and 
output of the music performance information may be 
performed by the external clock device and reproduction 
and output of the object information may be carried out 50 
by one or a plurality of synchronous information repro- 
duction apparatuses 1 . 

[0039] Here : description will be given on the assump- 
tion that the control information (for example, a MIDI 
message) including information for designating start/ 55 
end of the performance or information for selecting a 
song to be performed is supplied from the external clock 
device 2 to the synchronous information reproduction 



apparatus 1 together with the dock signal (for example, 
F8 of the MIDI message). 

[0040] In the synchronous information reproduction 
apparatus 1 , a reference numeral 11 denotes receiving 
section for receiving a clock signal and a control signal 
from the external clock device 2; 12, a mode switching 
section for setting a synchronous mode (an external 
synchronous mode or an internal synchronous mode) in 
the synchronous information reproduction apparatus 1 ; 
13, a synchronizing section for setting a reproduction 
speed of object information stored in the storing section 
16 in accordance with a reception timing of the clock 
signal from the receiving section 11; 14 : reproduction 
point generating section for generating a reading posi- 
tion (reproduction point) of object information stored in 
the storing section 16 sequentially in accordance with 
the reproduction speed determined by the synchroniz- 
ing section 1 3; 1 5, a reproducing section for reading the 
object information stored in the storing section 1 6, per- 
forming interpolation according to needs and thereafter 
generating a corresponding reproduction output signal; 
17, an outputting section for outputting the object infor- 
mation in accordance with the reproduction output sig- 
nal from the reproducing section 15; 18, a reproduction 
point correcting section for measuring a time duration 
from start of reproduction process by the reproducing 
section 15 till completion of the reproduction output in 
the outputting section 1 7 so as to correct the reproduc- 
tion point from the reproduction point generating section 
14; and 19, an internal clock section for generating an 
internal clock signal for specifying an operation timing 
of each of the constituent sections in the synchronous 
information reproduction apparatus 1 . 
[0041] As described above, although this synchro- 
nous information reproduction apparatus 1 has an ex- 
ternal synchronous mode for reproducing the object in- 
formation in synchronization with a clock signal fed from 
the external clock device 2, and an internal synchronous 
mode for reproducing the object information at a preset 
reproduction speed irrespective of the clock signal. 
Here, it is assumed that the external synchronous mode 
is set by the mode switching section 12. Incidentally, 
when a command by a user or collapse of the external 
synchronization is detected or failure in supply of the 
clock signal due to disconnection and the like is detect- 
ed, the mode switching section 12 sets the operation 
mode to the internal synchronous mode so that the ob- 
ject information can be reproduced at the preset repro- 
duction speed or the last reproduction speed before col- 
lapse of the synchronization. 

[0042] In addition, object information which is repro- 
duced in association with a song in accordance with a 
tempo of the song to be performed is stored in the stor- 
ing section 16 as a sequence of data (reproduction da- 
ta). For example, object information on various kinds of 
mediums such as polygon CG operation data (for exam- 
ple, sequence of data of joint angles of a skeleton mod- 
el), MIDI performance data, movies, or WAVE data is 
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stored as the sequence of data. 

[0043] In the synchronous information reproduction 
apparatus 1 having such an arrangement, the clock sig- 
nal and the control information (MIDI message) from the 
external clock device 2 are received by the receiving s 
section 11 of the synchronous information reproduction 
apparatus 1 ; location information indicative of a recep- 
tion timing of the received clock signal is supplied to the 
synchronizing section 13; control information indicative 
of start/stop of performance in the above-mentioned 10 
control information is supplied to the reproduction point 
generating section 14; and information for selecting a 
song to be performed in the above-mentioned control 
information is supplied to the storing section 1 6. 
[0044] The synchronizing section 1 3 determines a re- *5 
production speed of the object information stored in the 
storing section 1 6 based on the information indicative of 
the reception timing of the clock signal fed from the re- 
ceiving section 11. That is, the synchronizing section 13 
predicts a time until the next clock signal is received from 20 
a reception interval of the past clock signals, and calcu- 
lates a speed for reading the object information to be 
reproduced until the next clock signal is received based 
on the prediction (an updating quantity, i.e., an incre- 
ment amount of a reading address of reproduction data 25 
stored in the storing section 16). As a result, even if an 
incoming cycle of a variable clock signal is changed, 
reading of the reproduction data can be synchronized 
with the variable clock signal. 

[0045] This reproduction speed information is sup- 30 
plied to the reproduction point generating section 14, 
and tne reading address (reproduction point) of the re- 
production data to be read from the storing section 16 
is calculated in the reproduction point generating sec- 
tion 1 4 so that the reading address is supplied to the 35 
reproducing section 15. 

[0046] The processing for generating the reproduc- 
tion point by the reproduction point generating section 
1 4 is executed in a cycle according to a type of the object 
information. For example, if the reproduction data is 40 
WAVE data, the reproduction point is updated in accord- 
ance with each cycle corresponding to the sampling fre- 
quency (for example, 44.1 kHz) of WAVE data. In case 
of CG data or movie data, the reproduction point is up- 
dated in accordance with a cycle determined according 45 
to a number of reproduction frames per one second (for 
example, 30 frames/second). 

[0047] The reproducing section 1 5 reads correspond- 
ing reproduction data from the storing section 1 6 based 
on the reproduction point supplied from the reproduction so 
point generating section 14, and generates the repro- 
duction output signal according to the reproduction data 
so that the generated signal can be supplied to the out- 
putting section 17. Usually, the interpolation processing 
in the order of a decimal fraction is carried out according 55 
to needs, since the reproduction point includes a deci- 
mal value. Specifically, this reproducing section 15 has 
means for reading the reproduction data from the storing 



section 16 and means for executing the interpolation 
processing according to needs. Further, if the object in- 
formation is a CG animation image, the reproducing 
section 15 has a graphic engine or a decoder. If the ob- 
ject information is musical tone waveform sample data 
such as WAVE data, the reproducing section has a D/A 
converter. 

[0048] The reproduction output signal outputted from 
the reproducing section 15 is supplied to the outputting 
section 1 7, and corresponding object is outputted. If the 
object information is image data, this outputting section 
17 has a display unit. If the object information is musical 
tone waveform sample data, the outputting section 17 
has a sound system. 

[0049] Here, depending on types of object informa- 
tion, a time duration from start of the reproduction proc- 
ess by the reproducing section 1 5 till output of the object 
information to the outputting section 17 may differ. For 
example, in case of reproduction of a CG animation im- 
age, a three-dimensional coordinate calculation about 
an apex and a normal line of each object, light illumina- 
tion and coloring, a texture coordinate calculation, pol- 
ygon formation, a projection coordinate calculation, vis- 
ual field clipping, bit map creation, and rendering 
processing (image generation processing) such as hid- 
den surface/transmission processing are carried out 
based on scene information or operation data. On the 
other hand, in case of reproduction of musical tone 
waveform data, only the interpolation processing of the 
read musical tone waveform sample data can suffice. 
Furthermore, the time duration required for processing 
may differ depending on hardware used in the reproduc- 
ing section 15. Therefore, the reproduction point cor- 
recting section 18 measures a time duration from start 
of the reproduction process by the reproducing section 
or from a command of reproduction to the reproducing 
section 1 5 till actual output of the object information to 
the outputting section 17, and shifts the reproduction 
point outputted from the reproduction point generating 
section 14 rearwards by a quantity corresponding to the 
measured time duration. Moreover, the obtained repro- 
duction point is supplied to the reproducing section 15, 
and a deviation of the output timing caused due to a dif- 
ference in contents type such as a sound or CG or in 
hardware used as the reproducing section is compen- 
sated so that the information of different types of medi- 
ums can be completely synchronously outputted with 
each other. 

[0050] As described above, according to the synchro- 
nous information reproduction- apparatus of the present 
invention, the cycle of the clock signal received in the 
synchronizing section 13 is measured, and a reception 
time of a next clock signal is predicted based on the 
measured cycle in order to determine a reading speed 
of the object information. Therefore, even if the cycle of 
the clock signal supplied from an external clock device 
is changed, the object information can be reproduced 
and outputted in synchronization with the clock signal. 
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[0051] Additionally, since the reproduction point cor- 
recting section 1 8 corrects the reproduction point so as 
to absorb a difference in processing time until the object 
information is outputted, the out of synchronization 
caused due to a difference in medium or a difference in 5 
hardware can be completely eliminated 
[0052] Embodiments of the synchronous information 
reproduction apparatus and th^ synchronous informa- 
tion reproduction method according to the present in- 
vention will now be described in detail hereinafter. 10 
[0053] FIG. 2 is a view showing the structgre of one 
embodiment of the synchronous information reproduc- 
tion apparatus to which the synchronous information re- 
production method according to the present invention is 
applied. In this drawing, reference numeral 1 denotes a is 
main body corresponding to the above -described syn- 
chronous information reproduction apparatus, and it is 
assumed that a personal computer Is used as the main 
body in this embodiment. In addition, reference numeral 
2 designates the above-mentioned external clock de- 20 
vice, and it is assumed that the external clock device is 
an external MIDI equipment such as a sequencer or a 
MIDI keyboard. Further, it is determined that the external 
MIDI equipment 2 functions as a master while the main 
body 1 serves as a slave. Selection of a song to be per- 25 
formed and control for start and end of reproduction of 
that song are carried out in the external MIDI equipment 
2, and music performance information (MIDI data) of 
that song is supplied to the main body 1 . Furthermore, 
synchronous reproduction process of object information 30 
such as CG of the performance operation and reproduc- 
tion process of the received music performance infor- 
mation are executed in the main body 1 . 
[0054] In the main body 1 , reference numeral 21 de- 
notes a CPU for carrying out control of the main body 1; 35 
22, a ROM storing therein a control program or various 
kinds of parameters; 23, a RAM used as a work area in 
which a program is loaded; 24, a clock generator for 
generating an operation clock or various kinds of timer 
interruptions; 25, a MIDI interface circuit (MIDI l/F) for 40 
transmitting/receiving MIDI data to/from the external 
MIDI equipment 2 and the like; 26, an input operator 
such as a character keyboard or a mouse; 27, an exter- 
nal storage device such as a hard disk device or a 
CD-ROM drive device; 28, a sound source for reproduc- *s 
ing a musical tone waveform signal from MIDI data; 29, 
a sound system for D/A converting and amplifying a mu- 
sical tone waveform signal from the sound source 28; 
30, an image computation unit (graphic engine) for gen- 
erating an image signal from CG image data indicative so 
of a performance operation and the like or movie data; 
and 31 , a display unit for displaying the CG image, the 
movie from the image computation unit 30 or various 
kinds of messages. 

[0055] Further, in the external MIDI equipment 2, ref- 55 
erence numeral 41 designates a CPU for controlling the 
entire operation of the external MIDI equipment 2; 42, a 
ROM for storing therein a control program and various 



kinds of parameters; 43, a RAM used as a work area 
and the like; 44, a clock generator for generating an op- 
eration clock and various kinds of timer interruptions; 45, 
a MIDI interface circuit (MIDI l/F) for inputting/outputting 
MIDI data with respect to the main body 1 ; 46, an input 
operator such as a MID keyboard, an operation panel 
and a wheel; 47, an external storage device such as a 
hard disk device; 48, a sound source for reproducing a 
musical tone waveform signal from MIDI data; 49, a 
sound system for D/A converting and amplifying a mu- 
sical tone waveform signal from the sound source 48 to 
be outputted; and 50, a display unit for displaying vari- 
ous kinds of messages and the like. 
[0056] Here, the external storage device 47 or the 
RAM 43 in the external MIDI equipment 2 stores therein 
music performance data (MIDI data, SMF (Standard 
MIDI File)) in accordance with each song to be per- 
formed, and the music performance data (MIDI data) of 
a selected song is supplied to the main body 1 through 
the MIDI interface 45. 

[0057] The external storage device 27 or the RAM 23 
in the main body 1 stores therein object information 
which is reproduced in association with the music per- 
formance in accordance with each song. In the above- 
described external synchronous mode, object informa- 
tion of a song to be selected by a MIDI message from 
the external MIDI equipment 2 is read and reproduced 
in synchronization with a timing clock (F8) included in 
the MIDI message. 

[0058] The respective external storage devices 27 
and 47 in the main body 1 and the external MIDI equip- 
ment 2 accommodate therein song files storing therein 
information concerning music performance in accord- 
ance with each song. Description will now be given as 
to the song files with reference to FIG. 3. 
[0059] FIG. 3(a) is a table showing an example of a 
song file accommodated in each of the main body 1 and 
the external MIDI equipment 2. As shown in the drawing, 
in the song file of the external MIDI equipment 2, per- 
formance data is recorded in accordance with each 
song. The performance data is stored in the form of an 
SMF (Standard MIDI file) as described above. In the il- 
lustrative example, respective sets of performance data 
for songs 1 to 3 are stored. 

[0060] Moreover, the song file stored in the main body 
1 stores object information of various kinds of mediums 
such as music performance data, CG operation data, 
WAVE data and movie data which should be reproduced 
in association with music performance in accordance 
with each song. One or a plurality of sets of object infor- 
mation are prepared in accordance with the song to be 
performed. For example, in case of one song, only pre- 
determined operation data for animating CG polygons 
is recorded as object information. In case of another 
song, both the similar operation data and the MIDI per- 
formance data are recorded. In the illustrative example, 
with respect to a song 1 , the CG operation data is stored 
together with the performance data for the song 1 as the 
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object information. The performance data and the movie 
data are stored for a song 2 as the object information, 
and the CG operation data, the WAVE data and the mov- 
ie data are stored for a song 3 as the object information. 
[0061] FIG. 3(b) is a diagram showing an example of 5 
a data structure of the object information stored in the 
main body 1 . In the illustrative example, each set of ob- 
ject information is constituted by a header portion stor- 
ing therein information of entire data and reproduction 
data consisting of a plurality of sets of packet data ob- 1 o 
tained by dividing the sequence of data into a.plurality 
of blocks (which will be referred to as packets hereinaf- 
ter) in matching with the clock timing. That is, in each 
packet, the reproduction data which should be repro- 
duced after reception of the timing clock (F8) till recep- 15 
tion of a next timing clock is arranged in time series. 
[0062] Here : the reproduction data is divided into 
packets at intervals of the timing clocks (F8) and stored. 
Therefore, at the time of reproduction, a number of lim- 
ing clocks (F8) received after start of reproduction 20 
equals to a packet number which is currently repro- 
duced. Accordingly, comparing a number of received 
timing clocks (F8) with the packet number which is cur- 
rently reproduced enables detection of the lost of syn- 
chronization of the reproduction data. 25 
[0063] Supplementary information inherent to the ob- 
ject information such as a size of the entire object infor- 
mation or a number of packets is stored in the header 
portion of the object information. Taking the case where 
the object information is CG animation information for 30 
instance, there is stored information such as a data size, 
an object property (data such as a shape, an arrange- 
ment or a skeleton model of a polygon object, or a point- 
er indicative of an area in which data is stored), a 
number of packets, and reproduction speed information 35 
(default reproduction speed). 

[0064] Here : the supplementary information (for ex- 
ample, the object property) may be stored in an addi- 
tional file so that reference can be made to this file. 
[0065] In addition, as shown in the drawing, the pack- 40 
et data is constituted by a header portion of each packet 
and time series data, and the header portion of the pack- 
et includes information indicative of, e.g., a packet size 
(or an address at the end of the packet) and a number 
of samples in the packet. 45 
[0066] Incidentally, although the reproduction data is 
physically divided into packets in accordance with in- 
coming intervals of the timing clocks in the example 
shown in FIG. 3(b), the reproduction data does not have 
to be physically divided into packets in this way. That is, so 
as shown in FIG. 3(c), packet address information such 
as an address of reproduction data (address with a head 
position as a reference) according to timing clock recep- 
tion timing may be enumerated in the header portion of 
the object information as a part of the header information 55 
so that the object information can be logically divided 
into packets at the timing of reading. That is, as shown 
in the drawing, in the header portion are stored an ini- 



tialization information portion recording therein informa- 
tion similar to that in the header portion of the object 
information and packet address information indicative 
of an address of, sequence of data according to recep- 
tion timing of each timing clock. It is to be noted that E 
denotes a code indicative of an end of the header. 
[0067] Incidentally, when the object information is CG 
animation data indicative of the progressive state of mu- 
sic performance of the song, such animated reproduc- 
tion data as that changes in a joint angle of the skeleton 
model of a performer with time are aligned in time series. 
In addition, in case of WAVE data or movie data, data 
recorded in a sampling cycle according to a type of data 
is provided. 

[0068] Further, although the object information in- 
cludes the performance data as described above, data 
having such a format as shown in FIGs. 3(a) and (b) 
does not have to be used as the performance data of 
MIDI. That is, since the MIDI data is synchronized with 
the timing clock (F8) from the external clock device 2, 
the usual MIDI file can be used as it stands. 
[0069] Furthermore, although different files are used 
in accordance with each set of object information in the 
above description, a plurality of sets of reproduction da- 
ta of different mediums or the same medium such as ih^ 
graphic operation data (data indicative oj an operation 
track of each part in a body of a performer or each part 
in an instrument in the CG animation) and the MIDI data 
may be stored in one file. Alternatively, they may be 
stored in different files and index data for making refer- 
ence to a corresponding file may be prepared. 
[0070] Description will now be given as to the state of 
synchronous reproduction in the synchronous informa- 
tion reproduction apparatus according to the present in- 
vention having such a structure. 
[0071] As described above, in this embodiment, the 
external MIDI equipment 2 serves as a master to select 
a song to be performed or the control reproduction of 
the selected song and supplies music performance in- 
formation of the selected song to the main body 1 . Thus, 
the detail of MIDI messages supplied from the external 
MIDI equipment 2 and the outline of the processing in 
the main body 1 according to these messages will be 
first described. As is well known, the MIDI messages 
are roughly classified into channel messages (80 to EF) 
concerning the actual performance, and system mes- 
sages (F0 to FF) commonly used in the entire MIDI sys- 
tem. The system messages are further divided into a 
common message, a real time message and an exclu- 
sive message. The external MIDI equipment 2 transmits 
selection information of a song to be performed, control 
information for controlling the reproduction operation, 
and a synchronous signal for reproducing the object in- 
formation in synchronization with the performance of the 
song to the main body 1 by using the system message. 
[0072] Upon starting the operation, the external MIDI 
equipment 2 transmits ACTIVE SENSING (FE) to the 
main body 1 . As a result, the main body 1 can confirm 
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that the external MIDI equipment 2 is connected. Fur- 
thermore, when a song to be performed is selected by 
the operation panel of the input operator 46 in the ex- 
ternal MIDI equipment 2, a song number (ID) for desig- 
nating the selected song is transmitted to the main body 5 
1 by the SONG SELECT (F3). Consequently, the main 
body 1 loads the object information of the selected song. 
Moreover, when an FF (fast-forward) or REW (rewind) 
button is operated on the operation panel in the external 
MIDI equipment 2, the song position pointer (F2) is io 
transmitted to the main body 1 in accordance with this 
operation, and a reproduction start position of the object 
information is set in accordance with this pointer. In ad- 
dition, when start of performance is directed in the ex- 
ternal MIDI equipment 2, START (FA) is transmitted, and 15 
the timing clock ( F8) and a M ID I message such as chan- 
nel messages (80 to EF) are also transmitted. In accord- 
ance with this transmission, the main body 1 starts to 
count the timing clock (F8), and also commences repro- 
duction of the object information in synchronization with 20 
this counting. Additionally, the main body 1 transmits the 
channel message to the sound source 28 to start repro- 
duction of the music performance information. Further, 
when the processing for stopping the performance is 
carried out on the operation panel in the external MIDI 25 
equipment 2, STOP (FC) is transmitted to the main body 
1 , and the main body 1 stops the music performance 
and the reproduction operation. Furthermore, when the 
operation for commanding restart is performed on the 
operation panel of the external MIDI equipment 2, CON- 30 
TINUE (FB) is transmitted to the main body 1 , and the 
main body 1 restarts the reproduction operation of the 
music performance information and the object informa- 
tion from the stopping position. 

[0073J Description will now be given as to the state of 35 
synchronous reproduction of the object information in 
the synchronous information reproduction apparatus 
according to the present invention. 
[0074] FIGs. 4 and 5 are time charts showing the state 
of synchronous reproduction in the synchronous infor- 40 
mation reproduction apparatus according to the present 
invention having such an arrangement. FIG. 4 shows 
how the object information is reproduced while main- 
taining synchronization with the timing clock when the 
cycle of the timing clock (F8) is extended during the mu- 45 
sic performance, and FIG. 5 shows the same when the 
cycle of the liming clock is shortened, in these drawings, 
a horizontal axis represents a time axis; (a), a time; (b), 
reception timing of the timing clock (F8); (c), predicted 
reception timing of the timing clock; and (d) and (e), a so 
packet of the reproduction data reproduced with each 
timing. The part (d) shows the state of reproduction in a 
first synchronous operation mode, and the part (e) 
shows the state of reproduction in a second synchro- 
nous operation mode. As described above, there are 55 
two synchronous operation modes, i.e., the first syn- 
chronous operation mode and the second synchronous 
operation mode in the present invention. 



[0075] In FIGs. 4 and 5, before the time t 1( it is as- 
sumed that connection between the main body 1 and 
the external MIDI equipment 2 is confirmed by at least 
the ACTIVE SENSING (FE), and selection of reproduc- 
tion data is carried out by the SONG SELECT (F3) men- 
tioned above. Furthermore, it is assumed that the timing 
clock (F8) is transmitted for initial synchronization be- 
fore REPRODUCTION COMMAND (FA). Therefore, at 
the time t v a number of received clocks is set to 0 with 
a packet position at the top (packet number: 0). 
[0076] When REPRODUCTION COMMAND (FA) is 
received at the time t FA , the reproduction operation is 
then started at the time at which the clock (F8) is 
received, and reading of the reproduction data is started 
from the packet 0. 

[0077] Thereafter, the reading speed of the packet k 
is controlled based on intervals of the clocks (F8) meas- 
ured immediately before. Moreover, in accordance with 
start of reading the packet k, a time t k+1 at which incom- 
ing of a next clock is predicted is specified. 

(Synchronous Operation Mode 1) 

[0078] If the next clock (F8) is not received (incoming 
cycle of the clock is extended) upon completion of read- 
ing of the packet k-1 , as shown in the synchronous op- 
eration mode 1 in FIG. 4(d), data at the tail end of the 
packet k-1 is repeatedly reproduced until the next clock 
arrives. Namely, the reproduction operation is temporar- 
ily stopped until the next clock arrives. Then, when the 
clock arrives at the time y 1 ^, the reading speed is re- 
calculated, and reproduction of the packet k is started 
at the calculated reproduction speed F s . 
[0079] On the other hand, as shown in FIG. 5, if the 
incoming cycle of the clock (F8) is shortened when read- 
ing the packet k-1 , the next clock arrives before the time 
V 

[0080] In such a case, reproduction of the current 
packet k-1 is aborted when the clock arrives at the time 
^adj (synchronous operation mode 1 in FIG. 5(d)). 
[0081] Then, the reading speed is recalculated, and 
reproduction of the packet k is started at the calculated 
reading speed F f . 

[0082] As described above, according to the synchro- 
nous operation mode 1 , synchronization established be- 
tween reproduction of the reproduction data and the 
clock signal can be maintained in both cases where the 
reception cycle of the clock signal is extended and 
where the same is shortened. 

(Synchronous Operation Mode 2) 

[0083] In the above-mentioned synchronous opera- 
tion mode 1 , it can be considered that reproduction is 
temporarily stopped when the clock cycle is extended, 
or the reproduction content becomes discontinuous 
when the clock cycle is shortened. As a countermeas- 
ure, in the synchronous operation mode 2, the synchro- 
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nization processing is changed as follows. 
[0084] If the next clock (F8) is not received (incoming 
cycle of the clock is extended) upon completion of read- 
ing of the packet k-1 (t k ), although the clock does not 
arrive at the time t k , reading of the next packet k is start- 
ed at the reproduction speed F f used up to this time for 
the meanwhile (k F in the drawing). 
[0085] Then, when the clock arrives at the time y^i, 
reproduction at the current speed is aborted, and read- 
ing speed of the packet data (the remaining part of the 
packet k: k') is recalculated based on the size of the re- 
maining part of the packet k and the clock incoming in- 
terval (tn** - t k .i). In addition, the reproduction is carried 
out at the recalculated speed F m . Thereafter, the sub- 
sequent packet is reproduced at a reading speed F s ac- 
cording to the timing clock (F8) having the extended cy- 
cle. 

[0086] On the other hand, as shown In FIG. 5, if the 
incoming cycle of the clock (F8) is shortened during the 
reading of the packet k-1 , the next clock arrives before 
reaching the time t k . 

[0087] In this case, as shown in FIG. 5(e), reproduc- 
tion at the current speed F s is aborted when the clock 
reaches the time t k ad i, and the reading speed F m of the 
packet data (remainder of the packet k-1 + packet k) is 
recalculated based on the size of the remainder of the 
packet k-1 + the packet k and the clock incoming interval 
(t k adj - 1^). Further, the remainder of the packet k-1 +the 
packet k (= packet k 1 ) is reproduced at the recalculated 
reading speed F m . Thereafter, reading of the packet is 
carried out at the reading speed F f according to the 
shortened cycle of the timing clock (F8). 
[0088] Incidentally, in case of the synchronous oper- 
ation mode 2, when the incoming cycle of the timing 
clock (F8) becomes double of the immediately preced- 
ing cycle, it is impossible to achieve synchronization on 
arrival of the next clock. Therefore, in case of detecting 
that the k-th timing clock (F8) corresponding to the pack- 
et k is yet to arrive, reading may be performed up to the 
tail end of the packet k and the reproduction operation 
may be similarly temporarily stopped as in the synchro- 
nous operation mode 1 . 

[0089] As described above, according to the synchro- 
nous operation mode 2, the clock signal and the repro- 
duction of the data may be synchronized with each oth- 
er, and the reproduction content can be prevented from 
becoming discontinuous. 

[0090] Description will now be given as to the 
processing in the main body 1 and the processing in the 
external clock device (external MIDI equipment) 2 in or- 
der to effect the synchronous reproduction operation 
shown in the synchronous operation modes 1 and 2 
mentioned above with reference to the flowcharts. 
[0091] FIG. 6 is a flowchart for explaining the overall 
operation of the main body 1 ; FIG. 7, a flowchart of the 
MIDI monitoring timer interruption processing; FIG. 8, a 
flowchart of the reproduction timer interruption process- 
ing in order to realize the synchronous operation mode 



1 ; FIG. 9, a flowchart of a modification of the reproduc- 
tion timer interruption processing illustrated in FIG. 8; 
FIG. 10, a flowchart of the reproduction timer interrup- 
tion processing in order to realize the synchronous op- 
5 eration mode 2; and FIG. 11 , an operation flowchart of 
the external MIDI equipment 2. 
[0092] The main body 1 executes the synchronous re- 
production process according to the present invention 
by the overall operation processing of the application 
10 program shown in FIG. 6, the MIDI monitoring timer in- 
terruption processing shown in FIG. 7, and the repro- 
duction timer interruption processing illustrated in FIGs. 
8 to 10. Here, both of the MIDI monitoring timer inter- 
ruption processing and the reproduction timer interrup- 
ts tion processing are activated by timer interruption gen- 
erated by the MIDI monitoring timer and the reproduc- 
tion timer provided in the clock generator 24 In a prede- 
termined cycle. In the MIDI monitoring timer interruption 
processing, a MIDI message fed from the external MIDI 
2° equipment 2 is received and the processing according 
to that MIDI message is carried out. In the reproduction 
timer interruption processing, the processing for repro- 
ducing the object information is carried out in synchro- 
nization with the timing clock (F8). 
25 [0093] In FIG. 6, when the operation of the application 
program for executing the synchronous information re- 
production method according to the present invention is 
started in the main body 1 , creation of various kinds of 
display windows, initialization of various kinds of param- 
30 eters, and initialization processing such as preparation 
for event monitoring are first carried out to start moni- 
toring of a user event in the step S1 . Here, the user event 
is an event which is generated in response to the oper- 
ation by a user using an input device such as a mouse. 
35 For example, there are an event for designating the ex- 
ternal synchronous mode, an event for directing the in- 
ternal synchronous mode : an event for designating ter- 
mination of a program, and an event for controlling a 
sound volume. 

40 [0094] The program waits until any user event is gen- 
erated (step S2), and executes a predetermined opera- 
tion in accordance with occurrence of an event (step 
S3). 

[0095] That is, if the generated user event is a pro- 
^5 gram termination command event, the processing ad- 
vances to the step S4 to carry out the termination 
processing such as nullification of windows drawn on 
the display screen, stop of the reproduction timer (= stop 
of the reproduction process), stop of the MIDI monitoring 
50 timer (= stop of the processing according to the MIDI 
input), release of various kinds of memory areas and 
others, thereby terminating this program. 
[0096] Moreover, if the external synchronous mode 
designating event is inputted, the processing proceeds 
55 to the step S5 to activate the MIDI monitoring timer. As 
a result, the MIDI monitoring timer generates an inter- 
ruption event for effecting the MIDI monitoring timer in- 
terruption processing in a predetermined cycle. Then, 
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the processing returns to the step S2 and waits until a 
user event again occurs. 

[0097] If other event is generated, the processing ac- 
cording to the event is conducted (step S6). That is, if 
there occurs an event such as designation of the internal 5 
synchronous mode, start of reproduction in the internal 
synchronous mode, command of stop and the like, set- 
ting of a sound volume, various settings of CG (selection 
of a background, setting of a view point and others), se- 
lection of a medium for actually performing reproduction 10 
in case of multiple kinds of reproduction mediums, and 
others, the processing according to the event is carried 
out. Then, the processing returns to the step S2 and 
waits for occurrence of a new user event. The above is 
a How ol the processing of the main routine in the main 15 
body 1 . 

[0098] FIG. 7 is a flowchart of the MIDI monitoring tim- 
er interruption processing. As described above, when 
the external synchronous mode is set, the MIDI moni- 
toring timer is activated (step S5), and the MIDI moni- 20 
toring timer interruption processing is executed by the 
interruption event generated by the M IDI monitoring tim- 
er in a predetermined cycle. In the MIDI monitoring timer 
interruption processing, a MIDI message supplied from 
the externa! MIDI equipment 2 is first fetched in the step 25 
S11 . Then, the corresponding processing is carried out 
in accordance with a type of the fetched MIDI message 
(stepS 12). 

[0099] At first, if there is no MIDI message received 
in the step S11, the processing proceeds to the step 30 
S18 f and judgment is made as to whether a predeter- 
mined time (fDr example, 300 msec) has passed after 
reception of ^he last MIDI message. This judgment is 
effected based on whether a timeout counter for count- 
ing the predetermined time is timed out. If there is no 35 
reception of any message within the predetermined time 
(if a result of judgment in the step S1 8 is YES), it is re- 
garded that connection with the external MID device 2 
is broken, and the mode is automatically changed to the 
internal synchronous mode. In addition, a message in- 40 
dicative of this change is displayed on the display unit 
31 to stop the operation of the MIDI monitoring timer 
(step S19). Therefore, the MIDI monitoring timer inter- 
ruption processing is not thereafter carried out unless 
the external synchronous mode is designated. 45 
[0100] Additionally, if the predetermined time has not 
passed arter reception of the last MIDI message, a result 
of judgment in the step S1 8 is NO, and the timeout coun- 
ter is decremented (step S20). Consequently, counting 
by the timeout counter proceeds. so 
[0101] If the MIDI message is received and the MIDI 
message is fetched in the step S1 1 , the processing ac- 
cording to the message is performed. 
[01 02] If the received message is a channel message 
(80 to EF) concerning actual performance, the process- 55 
ing advances to the step S1 7, and that message is sup- 
plied to the sound source 28 (FIG. 1). As a result, the 
processing according to that MIDI message is effected, 



and the automatic performance is hence carried out. 
Subsequently, the processing proceeds to the step S14, 
and the timeout counter is reset. Then, judgment is 
made as to whether the processing is completed with 
respect to all of the MIDI messages fetched in the step 
S1 1 . If any other message is fetched, the processing re- 
turns to the step S12, and the processing according to 
that message is executed. Further, if the processing with 
respect to all of the messages is completed, the current 
MIDI monitoring timer interruption processing is termi- 
nated, and the processing returns to the overall process- 
ing (FIG. 6). 

[0103] If the MIDI message fetched in the step S11 is 
a timing clock (F8), the processing advances to the step 
S1 3. This timing clock (F8) is a variable clock, 24 pulses 
of which are transmitted with respect to one crotchet. 
Further, the transmission interval of this clock is appro- 
priately changed in accordance with a performance tem- 
po. For example, in case of Tempo = 100, since there 
are 1 00 crotchets per one minute, the transmission in- 
terval of F8 is 60/(100x24) sec = 25 msec. 
[0104] In the step S13, a count value of a counter for 
counting a number of received clocks is incremented 
(+1), and a current time is substituted for a clock recep- 
tion time register T_Last. Furthermore, a differencef rom 
the previous F8 reception time is taken and a timing 
clock (F8) reception interval At is meastired. Moreover, 
the processing proceeds to the step S14, and the time- 
out counter is reset. If there is no received MIDI mes- 
sage which is yet to be processed, the current MIDI 
monitoring timer interruption processing is terminated. 
[0105] In addition, if the MIDI message fetched in the 
step S11 is other system message, the processing ac- 
cording to the message is carried out in the step S16, 
and the timeout counter is then reset in the step S14. 
Thereafter, the processing proceeds to the step S15. 
[0106] For example, if the received MIDI message is 
SONG POSITION POINTER (F2) for informing of a 
point at which music performance should be started, the 
SONG POSITION POINTER (F2) is transmitted to the 
sound source 28 in the step S16. Additionally, a repro- 
duction start position of the object information is set, 
namely, the number of a packet to be reproduced is set 
to a position designated by the SONG POSITION 
POINTER (F2). This SONG POSITION POINTER (F2) 
is usually designated in units of one beat (F8 x 6). 
[0107] If the received MIDI message is SONG SE- 
LECT (F3), reproduction data having an ID designated 
by the SONG SELECT (F3) is selected from the repro- 
duction data stored in the external storage device 27 in 
the step S1 6, and the selected reproduction data is load- 
ed into the RAM 23. In this connection, if the SONG SE- 
LECT (F3) is received during reproduction of a song, 
reproduction of that song may be forcibly terminated. 
[0108] If the received MID message is START (FA), 
the position of the packet to be reproduced in the repro- 
duction data selected by the SONG SELECT (F3) is re- 
set to the top position, and the reproduction timer is ac- 
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tivated. The reproduction timer generates an interrup- 
tion event for carrying out the reproduction process of 
the reproduction data in a predetermined cycle F, there- 
by starting the reproduction operation. 
[0109] If the received MIDI message is CONTINUE 
(FB), the reproduction operation is restarted from a po- 
sition of the packet designated by the SONG POSITION 
POINTER (F2) in the reproduction data selected by the 
SONG SELECT (F3) or a position of the packet at which 
reproduction is stopped by STOP (FC). That is, the re- 
production timer is activated or reactivated. 
[01 1 0] If the received MID message is STOP (FC) 5 the 
reproduction timer is stopped to halt the reproduction 
process. Meanwhile, if the STOP (FC) is received during 
the reproduction, the reproduction point is set in units of is 
one beat. 

[0111J If the received MID message is ACTIVE 
SENSING (FE), the processing of the step S1 6 is termi- 
nated as it is, thereby proceeding to the step S14. 
[01 12J Incidentally, a number of received clocks in the 20 
later-descrfoed reproduction timer interruption process- 
ing is basically reset to 0 in accordance with reception 
of START (FA) mentioned above. However, if the SONG 
POSITION POINTER (F2) is received or if reproduction 
is stopped by the STOP (FC), a number of received' 25 
clocks is set to a number corresponding to the SONG 
POSITION POINTER (F2) or a number corresponding 
to a packet position at which reproduction is stopped by 
the STOP (FC) and thereafter restarted. 
[0113] As described above, in the MIDI monitoring 30 
timer interruption processing, the MIDI message is 
fetched in accordance with a predetermined cycle, and 
the processing according to the received MIDI message 
is performed. Furthermore, if no MIDI message is re- 
ceived beyond a predetermined time (for example, 300 35 
msec), it is determined that the connection with the ex- 
ternal MIDI equipment 2 is broken, and the processing 
for switching to the internal synchronous mode is carried 
out. 

[01 14] Description will now be given as to the repro- 40 
duction timer interruption processing. It is to be noted 
that reproduction of a single set of object information will 
be explained hereinafter for the sake of simplicity. In 
case of reproducing a plurality of sets of object informa- 
tion, the processing such as generation of a reproduc- 45 
Won point, reading of reproduction data, generating of a 
reproduction output signal and others may be carried 
out relative to respective sets of reproduction data in 
parallel. 

[01 15] Description will be first given on the reproduc- so 
tion timer interruption processing in case of performing 
the processing in the synchronous operation mode 1 ex- 
plained with reference to FIGs. 4(d) and 5(d). FIG. 8 is 
an operation flowchart of the reproduction timer inter- 
ruption processing in order to enable the operation in 55 
the above-mentioned synchronous operation mode 1 . 
[0116] As described above, if reproduction of the ob- 
ject data is directed by START (FA), CONTINUE (FB) 



or a user event, the reproduction timer is made active, 
and this processing is executed in accordance with a 
predetermined interruption cycle F. 
[01 17] In this reproduction timer interruption process- 
ing, judgment is first made as to whether the current 
mode is the internal synchronous mode (step S21). If 
the current mode is the internal synchronous mode as 
a result of judgment, the processing advances to the 
step S28, and a reading position (reproduction point) Ptr 
of the packet data is calculated by the following expres- 
sion (1). That is: 

Ptr=Ptr + C (1) 

where C is a speed for reading the packet (repro- 
duction speed). In this connection, since the reproduc- 
tion point Ptr is actually a value including a decimal fig- 
ure, the spline interpolation and the like is effected from 
the packet data in the vicinity of the reproduction point, 
thereby generating data at a corresponding point. Then, 
the processing proceeds to the step S29. 
[0118] If the current mode is not the internal synchro- 
nous mode, the processing advances to the step S22, 
and judgment is made as to whether a timing clock (F8) 
has been newly received before the current reproduc- 
tion timer interruption processing. If it is determined that 
the timing clock (F8) has been received as a result of 
the judgment, the reading packet number is shifted to 
the number of a next packet, and the F8 reception inter- 
val measured in the step S1 3 of the MIDI monitoring tim- 
er interruption processing is used to update the repro- 
duction speed C. Further, the reading position is reset 
(set to the top of the next packet), and a predicted re- 
ception time of a next timing clock (F8) is updated (step 
S23). 

[0119] Here, the new reproduction speed C is updat- 
ed based on the size of the packet (number of data) L 
from which reading is started, the reception interval At 
of F8, and the reproduction timer interruption cycle F 
(which depends on a type of object information and 
hardware). That is: 

C = At/(FxL) (2) 

[0120] Further, a predicted reception time t^ of a 
next timing clock (F8) is updated based on the following 
expression: 

tnext^last + At (3) 

[0121] Then, the processing advances to the step S24 
and judgment is made upon an out of synchronization. 
That is, a number of packets (packet number) at this mo- 
ment is compared with a number of F8 received after 
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start of reproduction to check if these numbers coincide 
with each other. 

[0122] If it is determined that these numbers do not 
coincide with each other as a result of judgment, the 
processing advances to the step S25 because of the out s 
of synchronism, and the current mode is changed to the 
internal synchronous mode. Further, a message inform- 
ing of this change is displayed end the MIDI monitoring 
timer is stopped. Consequently, the synchronous 
processing according to reception of the timing clock is w 
not performed, but the reproduction is continued at the 
current reproduction speed C. Then, the processing pro- 
ceeds to the step S31 . On the other hand, if these num- 
bers coincide with each other, the processing directly 
advances to the step S31 . In case of the external syn- is 
chronous mode, the timing clock (F8) transmitted from 
the external MIDI equipment 2 is synchronized with the 
reproduction timing of each packet in the above-de- 
scribed manner. 

[0123] On the other hand, if F8 is not received in the 20 
step S22, the processing advances to the step S26, and 
judgment is made as to whether the current time ex- 
ceeds the time t^ at which F8 is predicted to be re- 
ceived. 

[01 24] If it is determined that the current time exceeds 25 
the predicted time t^* as a result of judgment, since the 
reading position has reached the tail end of the packet 
which is currently read, the processing advances to the 
step S27, and reading of the packet is temporarily 
stopped until a next clock arrives. It is to be noted that 30 
the processing is not substantially carried out in the next 
step S31 in this case. 

[0125] On the other hand, if the current time does not 
exceed the predicted time t^^, the processing advanc- 
es to the step S28, and the expression (1) is used to 35 
calculate the reproduction point in this reproduction tim- 
ing as similar to the above-described case. Then, the 
processing advances to the step S29. 
[01 26] In the step S29, judgment is made as to wheth- 
er the reproduction point calculated in the step S28 ex- 40 
ceeds a length (size) of the packet which is currently 
reproduced. If it does not exceed the length, the 
processing advances to the step S31 . However, if it ex- 
ceeds the length, the packet number is updated to the 
number of a next packet, and the reproduction point is 45 
set to a position of the top (= 0) of that packet. Then, the 
processing proceeds to the step S31 . 
[0127] As described above, after execution of the 
processing such as the steps S25, S30 and others, the 
processing advances to the step S31 where the object so 
data is read from the reproduction point designated in 
each case. At this time, the reproduced data is located 
at a position (address) shifted rearwards from the repro- 
duction point by an amount of the later-described offset. 
Subsequently, the interpolation processing is carried out ss 
with respect to the read reproduction data according to 
needs, and the processing for generating the reproduc- 
tion output signal in this timing is performed based on 



this data. For example, if the object information is CG 
animation data, the necessary interpolation processing 
is applied to the read operation data, and the resulting 
data is transferred to the image computation unit 30. 
Then, updating the object is directed. 
[0128] Furthermore, in the step S31, the processing 
time T out from start of this reproduction process to actual 
output of the object information to the outputting section 
17 is measured. Here, the processing time T^ to be 
measured may be either a time from commanding of 
reading of the reproduction data till output of the repro- 
duction data to the outputting section 1 7, or a time from 
output of the reproduction data which has been read and 
subjected to the interpolation processing to processing 
means such as the image operating section 30 till com- 
pletion of the reproduction operation (from rendering till 
output of data to the display unit 31 in case of CG). More- 
over, an average value T out *v of the processing time T out 
measured with respect to the reproduction data is cal- 
culated in advance, and the offset corresponding to the 
average value T out AV is used as a correction value for 
the above-described reproduction point in case of read- 
ing the reproduction data in the step 31 of the next re- 
production timer interruption processing. Therefore, as 
to the position of the packet data which is actually read, 
data is read at the position which is shifted rearwards 
by an amount of the offset. Consequently, it is possible 
to absorb a gap of synchronization depending on the 
hardware specifications and the like for the reproduction 
output timing of each medium (sounds, images and oth- 
ers). 

[0129] Incidentally, the incoming time t^ of the tim- 
ing clock is predicted in the reproduction timer interrup- 
tion processing (1 ) shown in FIG. 8, the processing may 
be carried out in accordance with whether the reading 
position has reached the tail end of the packet without 
predicting the incoming time. 

[01 30] FIG . 9 is a flowchart showing a modification of 
the reproduction timer interruption processing (1) men- 
tioned above. 

[0131] In this case, judgment is made as to whether 
a new timing clock (F8) has been received in the step 
S41. If it is determined that the timing clock (F8) has 
been received as a result of judgment, the processing 
proceeds to the step S42. Then, as similar to the step 
S28 in FIG. 8, the packet is shifted to the next packet, 
and the incremental reproduction speed is calculated 
based on the reception interval of F8 and a number of 
data in the packet. Moreover, the reproduction point is 
set to a position of the top of the next packet. However, 
the processing for updating the predicted reception time 
of the next timing clock (F8) is not performed. Then, the 
processing advances to the step S43, and judgment is 
made if out of synchronism occurs. In case of no out of 
synchronization as a result of judgment, the processing 
directly proceeds to the step S50. On the other hand, in 
case of the out of synchronization, the processing ad- 
vances to the step S44, a message informing the out of 
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synchronization and change to the internal synchronous 
mode is displayed. Subsequently, the current mode is 
switched to the internal synchronous mode, and the 
MIDI monitoring timer is stopped. Thereafter, the 
processing proceeds to the step S50. 5 
[0132] If the timing dock (F8) has not been received 
and a result of judgment in the step S41 is NO, the 
processing advances to the step S45, and the reproduc- 
tion point Ptr at which object information should be read 
in this reproduction timing is calculated based on the ex- 10 
pression (1). Moreover, in the step S46, judgment is 
made as to whether the reproduction point Ptr calculat- 
ed in the step S45 is a position exceeding the length 
(size) of the packet which is currently read. If it is deter- 
mined that the reproduction point Ptr does not exceed is 
the length of the packet as a result of judgment, the 
processing directly proceeds to the step S50. If the re- 
production point Ptr exceeds the length of the packet, 
the processing advances to the step S47, and judgment 
is made as to whether the current operation mode is the 20 
internal synchronous mode. In case of the internal syn- 
chronous mode as a result of judgment, the processing 
proceeds to the step S48, and the packet number is up- 
dated to the number of a next packet, and the reproduc- 
tion point is corrected to a position of the top of that pack- 25 
et. On the other hand, in case of no internal synchronous 
mode, namely, in case of the extern*?! synchronous 
mode, the processing proceeds to the step S49 and 
reading of the packet is temporarily stopped. It is to be 
noted that the substantial processing is not carried out 30 
in the next step S50 in this case. 
[01 33] If a result of judgment in either of the step S44 
or S43 is NO and a result of judgment in either of the 
step S48 or S46 is NO, the step S50 is subsequently 
executed. The step S50 reads the reproduction data lo- 35 
cated at a position where the above-described correc- 
tion processing has been carried out relative to the re- 
production point designated by the packet having any 
packet number specified in each case mentioned 
above, and generates the operation data based on the 40 
read reproduction data. Further, the processing for di- 
recting updating of a display object is executed. Then, 
as similar to the above -described case, the time T out 
from start of the reproduction process till completion of 
the reproduction operation is measured, and an average 45 
value T M M of the measured time duration T out is recal- 
culated. Consequently, as described above, it is possi- 
ble to absorb the loss of synchronization depending on 
the hardware specification for the reproduction output 
timing of each medium. Thereafter, the current repro- so 
duction timer interruption processing is terminated. The 
above is the processing flow of the main body 1 in case 
of effecting the operation in the synchronous operation 
mode 1 shown in FIGs. 4 and 5. 

[0134] Description will now be given as to the repro- 55 
duction timer interruption processing in case of effecting 
the operation in the synchronous operation mode 2 
shown in FIGs. 4(e) and 5(e). FIG. 10 is an operation 



flowchart of the reproduction timer interruption process- 
ing for carrying out the operation in the synchronous op- 
eration mode 2 mentioned above. 
[0135] As similar to the synchronous operation mode 
1 , if the reproduction of the sequence data is designated 
by START (FA), CONTINUE (FB) or a user input event, 
the reproduction timer is made active, and this process- 
ing is carried out in accordance with each predeter- 
mined cycle F. 

[0136] Upon starting the reproduction timer interrup- 
tion processing, judgment is first made as to whether a 
new timing clock (F8) has been received in the step S51 . 
Here, when operating in the internal synchronous mode, 
the MIDI monitoring timer is not operated as described 
above, and the MIDI monitoring timer interruption, 
processing (FIG. 7) is not executed. Thus, a result of 
judgment in the step S51 is NO. Additionally, in case of 
operating in the external synchronous mode, if the tim- 
ing clock (F8) has not been received with this reproduc- 
tion timing, a result of judgment is also NO. If the timing 
clock (F8) has not been received and a result of judg- 
ment in the step S51 is NO, the processing advances to 
the step S60, and the position Ptr for reading the packet 
data is calculated based on the currently set reproduc- 
tion speed C by using the expression (1 ). 
[0137] On the other hand, if the timing clock (F8) has 
been received, the processing for updating the repro- 
duction speed C, i.e., the reproduction synchronization 
based on the reception interval of the timing clock (F8) 
is executed at the step S52 in accordance with the re- 
ception time. This updating processing is the processing 
for updating the reproduction speed C using the expres- 
sion (2) and for updating the predicted reception time 
^ of a next timing clock (F8) using the expression (3), 
as similar to the case of the synchronous operation 
mode 1 mentioned above. However, in case of the syn- 
chronous operation mode 2, the packet length (size of 
the packet) L is set in accordance with the reception tim- 
ing of the timing clock (F8) as follows. 

(a) When the clock cycle is extended: 

L = an amount of remaining data of the packet 
which is currently reproduced 
= packet length - Ptr 

(b) When the clock cycle is shortened: 

L = an amount of remaining data of the packet 
which is currently reproduced + a length of a 
next packet 

= a length of the current packet + a length of a 
next packet - Ptr 

(c) When the clock cycle is not changed: 

L = a length of a next packet 

[01 38] That is, as a result of comparing the reception 
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time with the predicted reception time t,^ of the timing 
clock (F8) (step S52), (a) if the reception time of F8 is 
behind the predicted reception time (when the cycle of 
F8 is extended), a number of the remaining data of the 
packet which is currently reproduced is determined as 
L (step S53). Further, (b) if the reception time of the tim- 
ing clock (F8) is ahead of the predicted reception time 
(when the cycle of F8 is shortened), a sum of a number 
of remaining data of the packet which is currently repro- 
duced and a number of data included in a next packet 
is determined as L (step S54). 

[0139] After setting the variable L in the step S53 or 
S54, the processing proceeds to the step S55, and the 
reproduction speed C is calculated based on the expres- 
sion (2) by using the reception interval of F8 and the 
variable L, and the predicted reception time t^^ in the 
next timing, and is updated in the step S57. Further- 
more, the processing advances to the step S58, and 
judgment is made if out of synchronization occurs in this 
case. However, since the packet number is not updated 
at this moment, the "packet number + 1" is compared 
with a number of received timing clocks. If the out of 
synchronism is determined as a result of comparison, a 
message informing of this state is displayed, the current 
mode is changed to the internal synchronous mode, and 
the MIDI monitoring timer is stopped (step S59). Then, 
the processing advances to the step S60. Furthermore, 
if synchronism is established, the processing proceeds 
to the step S63, the packet number is updated, the re- 
production point is set to a position of the top of that 
packet, and the processing advances to the step S64. 
[0140] In the step S60, the reproduction point is cal- 
culated by using the reproduction speed C according to 
each case mentioned above. Then, in the step S61, 
judgment is made as to whether the calculated repro- 
duction point exceeds the size of the current packet. If 
it does not exceed, the processing advances to the step 
S64. If it exceeds, the processing proceeds to the step 
S62, the packet number is updated to the number of a 
next packet, and that reproduction point (reading posi- 
tion) is corrected. That is, if the clock cycle is delayed, 
the reading position Ptr may exceed a range of the cur- 
rent packet. In such a case, the length of the current 
packet is subtracted from Ptr, and the obtained result is 
corrected to a corresponding reading position in a next 
packet. That is, the following expression is used: 

Ptr = Ptr - a current packet length (4) 

[0141] Then, the processing proceeds to the step 
S64. 

[0142] In the step S64, the reproduction data is read 
from the reproduction point determined by the step S60, 
S62 or S63, and the processing for generating and out- 
putting a reproduction output signal to the outputting 
section is carried out. At this time, as similar to the step 
S31 or S50, the time required for completing the output 



is measured, and a deviation from the actual reproduc- 
tion timing is compensated. The above is a flow of the 
reproduction timer interruption processing for conduct- 
ing the synchronous operation mode 2 shown in FIG. 4 
5 (e) and FIG. 5(e). 

[0143] FIG. 11 is a flowchart showing the operation of 
the external MIDI device 2. When the power supply is 
turned on, as similar to the above-described main body 
1, the initialization processing is first performed, and 
10 monitoring of occurrence of a user event is started 
(Steps S71 and S72). Here, the user event is generated 
in accordance with the operation of the input operator 
46 (various kinds of operators such as a switch or a lever 
on the operation panel, or various kinds of performance 
f 5 operators such as a keyboard or a wheel). When any 
user event is produced, a type of the user event is rec- 
ognized in the step S73, and corresponding processing 
is carried out in accordance with a type of the user event. 
Then, the processing returns to the step S72 to get pre- 
zo pared for a next user event. 

[01 44] The generated user event includes a reproduc- 
tion setting command such as selection of a song and 
reproduction data, setting of a reproduction start posi- 
tion, a reproduction start/stop/restart command and the 
25 like. The processing advances to the step S74, and the 
before-described MIDI message according to each 
command (SONG POSITION (F2), £ONG SELECT 
(F3), START (FA), CONTINUE (FB), STOP (FC) and the 
like) is generated. Furthermore, judgment is made as to 
30 whether the current mode is set to the external synchro- 
nous mode (step S75). In case of the external synchro- 
nous mode, the corresponding MIDI message is trans- 
mitted to the main body 1 , and the processing proceeds 
to the step S77. Moreover, if the current mode is set to 
35 the internal synchronous mode, the processing directly 
advances to the step S77. In the step S77, the process- 
ing in its own device according to the reproduction set- 
ting command is carried out. That is, the MIDI message 
according to the reproduction setting command is sup- 
40 plied to the sound source 48, and preparations for ef- 
fecting the performance processing of the set song are 
made. Subsequently, the processing returns to the step 
S72. 

[01 45] If the generated user event is an external syn- 
45 chronous mode designation event, the processing ad- 
vances to the step S78, and ACTIVE SENSING (FE) is 
transmitted to the external device (main body 1). In ad- 
dition, transmission of the timing clock (F8) is started. 
Additionally, there is also started the monitoring 
50 processing by which ACTIVE SENSING (FE) is trans- 
mitted if any MIDI message is hot transmitted beyond 
300 msec. Then, the processing returns to the step S72. 
It is to be noted that transmission of the timing clock (F8) 
may be started after the reproduction start/restart com- 
55 mand is made. In such a case, the timing clocks (F8) 
are transmitted for a predetermined number of times be- 
fore transmitting START (FA) and CONTINUE (FB). 
[0146] If the generated user event is other event such 
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as setting of a performance tempo or generation of a 
musical tone signal according to the operation of the 
performance operator, the processing advances to the 
step S79, and the processing according to the user 
event is effected. For example, if the reproduction tempo s 
(performance tempo) is changed, the transmission in- 
terval of the timing clock (F8) is changed from this mo- 
ment in time (or changed after completion of reproduc- 
tion of one beat or one bar) in accordance with the set 
tempo. Then, the processing returns to the step S72. 10 
The above is the processing operation of the external 
MIDI equipment 2. 

[0147] Although the synchronous information repro- 
duction apparatus according to the present invention 
and the embodiment of the synchronous information re- is 
production apparatus have been described above in de- 
tail, the present Invention is not restricted thereto, and 
it is possible to make various modifications such as de- 
scribed below. 

[0148] For example, in all the devices executing syn- 20 
chronous reproduction, the timing for actually effecting 
the reproduction operation may be shifted from the tim- 
ing in which the timing clock (F8) has been received. 
That is, in all the devices, the timing clock (F8) reception 
timing corresponding to a \ redetermined number of 25 
clocks (a number of clocks corresponding to the time of 
approximately 100 msec is desirable) may be stored, 
and the reproduction operation with the clock immedi- 
ately after receiving START (FA) being used as a refer- 
ence may be started upon completion of reception of the so 
predetermined number of timing clocks (F8) without ex- 
ecuting the actual reproduction operation from F8 im- 
mediately after reception of START (FA) till reception of 
the predetermined number of F8. 

[01 49] Further, in the above-described embodiments, 35 
if SONG POSITION POINTER (F2)ls received or if re- 
production is stopped by STOP (FC), a number of re- 
ceived clocks in the reproduction timer interruption 
processing is set to a number corresponding to the 
SONG POSITION POINTER (F2) or a number corre- 40 
sponding to the packet position at which reproduction is 
stopped by STOP (FC), and then restarted. However, a 
number of received clocks may be always initialized to 
0. In this case, judgment may be made if out of synchro- 
nism occurs in the reproduction timer interruption *s 
processing based on a number of clocks after starting 
the reproduction and a number of packets after starting 
the reproduction. 

[0150] Furthermore, in the above-described embodi- 
ments, when the reception cycle of the timing clock (F8) so 
is changed, temporary stop of reproduction, abortion of 
reproducing the immediately preceding packet or count- 
ing a number of samples of sequence data which should 
be reproduced before receiving a next timing clock (F8) 
is carried out in order to recalculate the reproduction ss 
speed in this section. However, if the reproduction data 
is sound data such as WAVE data, the pitch may be dis- 
advantageous^ changed or the waveform becomes dis- 



continuous, thereby generating noises. As a counter- 
measure, a joint area in which the same content as that 
of a packet adjacent to each packet is recorded may be 
set in advance, and reading of a next packet may be 
started without changing the reproduction speed itself 
(maintaining the default reproduction speed) if the tim- 
ing clock (F8) is received before reaching the tail end of 
the packet which is currently being read. Moreover, all 
of the remainder in the current packet (or a predeter- 
mined number of samples) may be continuously read, 
and they may be cross-faded to be outputted. In addi- 
tion, if the timing clock (F8) is not received even after 
reaching the tail end of the packet which is currently be- 
ing read, the joint area at the rear of the current packet 
may be repeatedly read and similarly cross-faded to be 
outputted at the time of receiving the timing clock (F8). 
[0151] In addition, in the above-described embodi- 
ments, although ACTIVE SENSING (FE) is transmitted 
from the external M ID I equipment 2 serving as a master, 
ACTIVE SENSING (FE) may be also transmitted from 
the main body 1 functioning as a slave so that mutual 
connection confirmation can be performed. 
[01 52] Further, in the above-described embodiments, 
the external M IDI equipment 2 transmits the timing clock 
(F8) before starting reproduction (before transmitting 
START (FA)). However, information concerning the 
transmission interval of the timing clock may be addi- 
tionally transmitted to the slave (main body 1) as initial- 
ization information in advance. 

[0153] Furthermore, in the above-described embodi- 
ments, as shown in FIG. 3(b), the reproduction data di- 
vided into blocks (divided into packets) according to 
each timing clock is used to generate the reproduction 
point in units of packet. However, the present invention 
can be readily applied to such a case where the repro- 
duction data logically divided into packets is used as 
shown in FIG. 3(c). That is, in this case, the current re- 
production point may be directly calculated from the top 
address of the reproduction data instead of effecting the 
processing such as updating the packet number or re- 
setting the reproduction point (setting to the top of a next 
packet) in FIGs. 8 to 10. 

[0154] Moreover, in spite of the fact that the clock 
master side (external MIDI equipment 2) transmits the 
timing clocks (F8) at a constant interval, the reception 
interval can be possibly slightly shifted for some reason. 
In order to cope with such a case, if the timing clock (F8) 
is received at a time ahead or behind the predicted re- 
ception time by a predetermined period/that clock may 
be regarded to be received just at the predicted recep- 
tion time and the processing may be then carried out. 
[01 55] In addition, in each of the above-described em- 
bodiments, the time T^ from start of the reproduction 
process till completion of the reproduction operation is 
measured every time in the steps S31 , S50 and S64 in 
the reproduction timer interruption processing shown in 
FIGs. 8 to 10. However, this measurement and calcula- 
tion of the average value T^av may De carr i ec j out at 
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predetermined intervals (for example, one time with re- 
spect to each packet). 

[0156] Additionally, the processing for correcting the 
reproduction point in the object information on a single 
medium is carried out in the above-described embodi- 
ments. In case of reproducing a plurality of object infor- 
mation in parallel, with one object information of a me- 
dium having the longest time required for reproduction 
process being used as a reference, the reproduction 
point may be corrected in such a manner that the output 
timing of other object information of other medium can 
be matched with the output timing of the reference ob- 
ject information. 

[0157] Further, although the operation of the MIDI 
monitoring timer is stopped in case of the internal syn- 
chronous mode in the above-described embodiments, 
the present invention does not have to be configured in 
this manner. That is, the MIDI monitoring timer interrup- 
tion processing is operated in advance and, in the inter- 
nal synchronous mode, the timing clock (F8) is internally 
generated in the main body 1 at a default time interval 
or at a time interval corresponding to a finally calculated 
reproduction speed and written in the reception buffer 
in which the MIDI message received by the MIDI inter- 
face circuit 25 is written. In this case, the steps S21 , S29 
and S30 with the mark in the reproduction timer in- 
terruption processing (1 ) shown in FIG. 8 and the steps 
S46 and S48 in the modification shown in FIG. 9 are no 
longer necessary. It is to be noted that the reproduction 
timer interruption processing illustrated in FIG. 10 does 
not have to be changed. 

[0158] Furthermore, if the reproduction data is CG an- 
imation data indicative of the state of the music perform- 
ance, drawing of a polygon object corresponding to a 
selected song may be started upon receiving the SONG 
SELECT (F3), and it is possible to enter the standby 
mode by repeatedly reading the leading data in the lead- 
ing packet of the reproduction data in the same cycle as 
that of the reproduction timer. Moreover, when repro- 
duction of the object data is completed to the tail end, 
the tail end portion of the reproduction data may be re- 
peatedly reproduced until a command such as termina- 
tion of the program or a change of the file is given. In 
addition, operation data for reproduction standby or ter- 
mination standby may be prepared in advance, and the 
operation data for reproduction standby or termination 
standby may be repeatedly reproduced until the repro- 
duction is started or a command such as termination of 
the program is given. 

[0159] Additionally, connection established between 
the external MIDI equipment 2 (clock master) and the 
main body 1 (slave) can be any kind of connection as 
far as MIDI messages can be transmitted. That is, any 
interface such as the MIDI interface employed in the em- 
bodiment, the serial interface, the USB, the IEEE 1394, 
or the Ethernet can be used. It is to be noted that the 
delay time of the transmission path must be compensat- 
ed in case of the Ethernet. Further, a wireless link can 



be used. 

[0160] Furthermore, in the above-described embodi- 
ments, although the external MIDI equipment 2 is the 
sequencer and the main body 1 is a PC, the present 

5 invention is not restricted thereto. In brief, any type of 
device can be used as far as transmission/reception of 
the MIDI messages (or a synchronous signal at least 
equivalent to the timing clock (F8)) is secured. It is pos- 
sible to use various kinds of devices such as a game 

10 machine, an audio device, a mobile phone, a MIDI de- 
vice like an electronic musical instrument, and a gener- 
al-purpose computer like a PC as the external MIDI 
equipment 2. 

[0161] Moreover, a plurality of slaves (main body 1) 
'5 for reproducing the sequence data may be provided in 
accordance with types of mediums for CG generation or 
WAVE data reproduction. In this case, when confirming 
connection, ACTIVE SENSING (FE) is transmitted from 
the clock master to a plurality of slaves. 
20 [0162] In addition, in case of the IEEE 1394, the ex- 
ternal MIDI equipment 2 serving as the clock master 
may broadcast FE (which can be of course used, orcon- 
nection confirmation and the clock master may be addi- 
tionally informed) to all the nodes when the power sup- 
25 p|y is turned on or the external synchronous mode is 
started. 

[0163] Additionally, the program for carrying out the 
processing, the sequence of data and others may be 
supplied to the external storage devices 27 and 47 as 
30 well as the RAMs 23 and 43 through a communication 
network of a public telephone service (such as a tele- 
phone network or Internet). 

[01 64] As described above, according to the inventive 
synchronous information reproduction apparatus, the 

35 synchronous information reproduction method and the 
storage medium storing therein a synchronous repro- 
duction program of the present invention, multimedia in- 
formation of various kinds of mediums can be synchro- 
nously reproduced with the reduced processing bur- 

40 dens. 

[01 65] Further, since the internal processing delay de- 
pending on the hardware specifications and the like can 
be absorbed, multimedia information on different types 
of mediums can be assuredly synchronized. 

45 [0166] Furthermore, since the external synchronous 
mode is switched to the internal synchronous mode 
when the out of synchronization and the like is caused 
due to, e.g., disconnection, the processing is not sud- 
denly stopped. Moreover, by informing of this switching, 

50 a user-friendly system can be provided. 

[01 67] In addition, selection of a file to be reproduced 
and the reproduction control can be executed from an 
external device. 
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1 . A synchronous information reproduction apparatus 



BNSDOCID: <EP 1 172798A2.L> 



17 



33 



EP 1 172 798 A2 



34 



comprising: 

a receiving means for sequentially receiving a 
clock signal; 

a storing means for storing object information 5 
to be sequentially reproduced from a series of 
reproduction points; 

a reproduction point generating means for gen- 
erating location information indicative of a re- 
production point of the object information to 
stored in the storing means; 
a reproducing means for reading and reproduc- 
ing the object information from the storing 
means based on the reproduction point gener- 
ated by the reproduction point generating 15 
means; 

a synchronizing means for synchronizing an In- 
cremental speed of the reproduction point gen- 
erated by the reproduction point generating 
means with a reception timing of the clock sig- 20 
nal based on a reception time interval of the 
clock signals; and 

an outputting means for outputting contents of 
the object information reproduced by the repro- 
ducing means. 25 

The synchronous information reproduction appara- 
tus according to claim 1 , further comprising a repro- 
duction point correcting means for measuring a time 
duration from a start of reproduction process of the 30 
object information by the reproducing means till an 
actual output of the object information from the out- 
putting means, and for correcting the reproduction 
point in accordance with the measured time dura- 
tion. 35 

The synchronous information reproduction appara- 
tus according to claim 1 or 2, further comprising a 
control means operative when a command by a us- 
er, an out of synchronism between the clock signal *o 
and the object information, or a stop of supply of the 
clock signal is detected, for suspending the opera- 
tion of the synchronizing means, and for controlling 
the reproduction point generating means to gener- 
ate the reproduction point at a predetermined incre- <*5 
mental speed. 

The synchronous information reproduction appara- 
tus according to claim 1 or 2, wherein selection of 
the object information stored in the storing means so 
and control of the reproduction process of the object 
information by the reproducing means are carried 
out in accordance with an externally supplied sig- 
nal. 

55 

The synchronous information reproduction appara- 
tus according to claim 1 or 2, wherein the object in- 
formation is divided into a series of blocks in corre- 



spondence with a series of the clock signals. 

6. The synchronous information reproduction appara- 
tus according to claim 1 , wherein the clock signal is 
provided from an external music equipment. 

7. The synchronous information reproduction appara- 
tus according to claim 1 , wherein the clock signal is 
provided in the form of a timing message contained 
in MIDI data. 

8. The synchronous information reproduction appara- 
tus according to claim 1, wherein the object infor- 
mation has multimedia contents selected from an 
image, a music waveform and a voice. 

9. A synchronous information reproduction apparatus 
comprising: 

a storing means for storing a plurality of object 
information; 

a reproduction point generating means for gen- 
erating location information indicative of re- 
spective reproduction points of the plurality of 
the object information stored in the storing 
means; 

a reproducing means for reading and reproduc- 
ing the plurality of the object information con- 
currently with one another from the storing 
means based on the respective reproduction 
points generated by the reproduction point gen- 
erating means; 

an outputting means for outputting contents of 
the plurality of the object information repro- 
duced by the reproducing means; and 
a reproduction point correcting means for 
measuring a time duration of each object infor- 
mation from a start of reproduction process of 
the object information by the reproducing 
means till an actual output of the object infor- 
mation from the outputting means, and for cor- 
recting the respective reproduction points of 
the plurality of the object information in accord- 
ance with the measured time duration of each 
object information. 

10. The synchronous information reproduction appara- 
tus according to claim 9, wherein the object infor- 
mation has multimedia contents selected from an 
image, a music waveform and a voice. 

11 . A synchronous information reproduction method of 
reproducing one or a plurality of object information 
stored in a storing means in synchronization with a 
clock signal, comprising: 

a reception step of sequentially receiving the 
clock signal; 
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a generation step of generating location infor- 
mation indicative of a reproduction point of the 
object information; 

a reproduction step of reading and reproducing 
the object information from the storing means 
based on the reproduction point generated by 
the generation step; 

a synchronization stepiof synchronizing an in- 
cremental speed of the reproduction point gen- 
erated by the generation step with a reception 
timing of the clock signal based on a reception 
time interval of the clock signals; and 
an output step of outputting contents of the ob- 
ject information reproduced by the reproduction 



12. The synchronous information reproduction method 
according to claim 1 1 , further comprising a repro- 
duction point correction step of measuring a lime 
duration from a start of processing in the reproduc- 
tion step till an actual output of the object informa- 
tion and correcting the reproduction point in accord- 
ance with the measured time duration. 

13. The synchronous information reproduction method 
according to claim 11 or 12, wherein the synchroni- 
zation step is stopped when a command by a user, 
an out of synchronism between the clock signal and 
the object information, or a stop of supply of the 
clock signal is detected, and wherein the reproduc- 
tion point is generated at a predetermined incre- 
mental speed in the reproduction step. 

14. A synchronous information reproduction method of 
reproducing a plurality of object information stored 
in a storing means, comprising: 

a generation step of generating location infor- 
mation indicative of respective reproduction 
points of the plurality of the object information 
stored in the storing means; 
a reproduction step of reading and reproducing 
the plurality of the object information from the 
storing means based on the respective repro- 
duction points generated by the generation 
step; 

an output step of outputting contents of the plu- 
rality of the object information reproduced by 
the reproduction step; and 
a reproduction point correction step of measur- 
ing a time duration of each object information 
from a start of processing in the reproduction 
step till an actual output of the object informa- 
tion, and correcting the reproduction point of 
each object information in accordance with the 
measured time duration. 

15. A storage medium for storing therein a program for 
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causing a computer to reproduce one or a plurality 
of object information stored in a storing means in 
synchronization with a clock signal, wherein the 
program comprising: 

a reception step of sequentially receiving the 
clock signal; 

a generation step of generating location infor- 
mation indicative of a reproduction point of the 
object information; 
a reproduction step of reading and reproducing 
the object information from the storing means 
based on the reproduction point generated by 
■ the generation step; 

a synchronization step of synchronizing an in- 
cremental speed of the reproduction point gen- 
erated by the generation step with a reception 
timing of the clock signal based on a reception 
time interval of the clock signals; and 
an output step of outputting contents of the ob- 
ject information reproduced in the reproduction 
step. 

16. The storage medium according to claim 1 5, wherein 
the program further comprises a reproduction point 
correction step of measuring a time duration from a 
start of processing in the reproduction step till an 
actual output of the object information, and correct- 
ing the reproduction point in accordance with the 
measured time duration. 

17. The storage medium according to claim 15 or 16, 
wherein the program further comprises a step of 
stopping the operation of the synchronization step 
and generating the reproduction point at a prede- 
termined incremental speed in the reproduction 
step when a command by a user, an out of synchro- 
nism between the clock signal and the object infor- 
mation, or a stop of supply of the clock signal is de- 
tected. 

18. A storage medium for storing therein a program for 
causing a computer to reproduce a plurality of ob- 
ject information stored in a storing means, wherein 
the program comprises: 

a generation step of generating location infor- 
mation indicative of respective reproduction 
points of the plurality of the object information; 
a reproduction stepof reading and reproducing 
the plurality of the object information concur- 
rently with one another from the storing means 
based on the respective reproduction points 
generated by the generation step; 
an output step of outputting contents of the plu- 
rality of the object information reproduced in the 
reproduction step; and 

a reproduction point correction step of measur- 
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ing a time duration of each object information 
from a start of processing in the reproduction 
step till an actual output of the object informa- 
tion, and correcting the reproduction point of 
each object information in accordance with the s 
measured time duration. 
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